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Introduction 

John F. Kennedy Space Center ■■ 


The idea behind this presentation is how the 
difference in definitions can change the 
application. 


1 . Look at history, concepts, and definitions. 

2. Link the TUR to measurement decision risk. 


3. Apply the Z540.3 TUR and measurement 
decision risk. 
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Development of Measurement Decision Risk 

John F. Kennedy Space Center 1 ■ 1 — 


• Roots are based on consumer and producer risk analysis first 
developed in the late 1940's and early 1950's 

• Alan Eagle 

• Frank Grubbs, and Helen Coon. 

• Eagle's 1 954 paper provided 

• methods for calculating the consumer and producer risk 

• methods for establishing “test limits,” referred to as guardbands today. 

• The focus of the paper was to analyze and mitigate the “test errors” 

• The key point to Eagle’s method was quantifying and using 
measurement decision risk as a part of the manufacturing process. 

• This concept is applicable to any processes where decisions are 
based on measurements. 
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Development of MDR and the TUR 

John F. Kennedy Space Center ■ 


• In 1955, U.S. Navy needed improved measurement reliability in the 
guided missile program. 

• In response, Jerry Hayes authored TM No. 63-106. Aspects of this 
TM are still relevant today 

• Calibrated equipment needed for testing, 

• Establishment of reasonable testing risk levels, 

• Reasonable design tolerances, 

• Adequate procedures for testing. 

• Building on Eagle’s work, Hayes proposed using a “family of curves” 
to determine specific testing risk. 

• The down-side was a new family of curves had to be established for 
each change in process or design tolerance. 

• Computing consumer risk was very arduous with slide rules 

• A 4:1 accuracy ratio was established for Navy policy 
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Existing Definitions 



John F. Kennedy Space Center 


American Society for Quality (ASQ) 


Test accuracy ratio - (1) In a calibration procedure, the test accuracy ratio (TAR) is 
the ratio of the accuracy tolerance of the unit under calibration to the accuracy 
tolerance of the calibration standard used. 

A UUT Tolerance 
TAR = — 

Std Tolerance 


Test uncertainty ratio - In a calibration procedure, the test uncertainty ratio (TUR) is 
the ratio of the accuracy tolerance of the unit under calibration to the 
uncertainty of the calibration standard used. 


TUR = 


UUTT olerance 
Std_Uncertainty 
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Existing Definitions 


John F. Kennedy Space Center — 

NASALS Space Shuttle Pmgram . NSTS 5300A (ID-2) 

Paragraph 4: Article or Material Measurement Processes 

The Expanded Uncertainty in any article or material measmvment 
process shall not exceed ten percent of the tolerance of the article or 
material characteristic being measured. 



Paragraph 5: Calibration Measurement Processes 

... the Expanded Uncertainty in any calibration measurement process 

shall not exceed 25 percent of the tolerance of the parameter being 
measured. 
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Existing Definitions 

John F. Kennedy Space Center — 


ANSI/NSCL Z540.1-1995 

Interpretive Guidance for Section 10.2 of the Handbook 

As a default alternative to doing an uncertainty analysis , a laboratory may rely on a 
Test Accuracy Ratio (TAR) of 4:1. A TAR of 4:1 means that the tolerance of the 
parameter (specification) being tested is equal to or greater than four times the 
combination of the uncertainties of all the measurement standards employed in 
the test. 


If it is determined that the TAR is less than 4:1, then one of the following methods 
may be used: uncertainty analysis as described above, guard-banding, widening the 
specification, or another appropriate method. 


Note: Some refer to TARs as Test Uncertainty Ratios or TURs 
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Existing Definitions 



John F. Kennedy Space Center 


ANSI/NSCL Z540.3-2006 

3.11 Test uncertainty ratio 

The ratio of the span of the tolerance of a measurement quantity subject to 
calibration, to twice the 95% expanded uncertainty of the measurement process 
used for calibration . 

NOTE: This applies to two-sided tolerances. 


Upper - Lower 

TUR = — — 

2-U 


U = k-u k = 2 
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MDR - The Influence Variables 

John F. Kennedy Space Center ■ 

Consumer Risk (False Accept Risk) equation based on Eagle’s work. 


CR = — • 
n © 



r oo jcr-Ik-H 


- (t 2 + s 2 ) 


ds dt 


-©d>t)H© 


There are three distinct variables, r, k, and b which influence the results. 


CR= CR{r,k,b ) 
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MDR - The Influence Variables 


John F. Kennedy Space Center 1 

The variable b is the deviation of the test limits from the spec limits 
[i.e., p ± (/cct x - jb<T e )]. 

For this discussion, the specification limits will equal the test limits 
(i.e., b = 0). 
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MDR - The Influence Variables 

John F. Kennedy Space Center ■ — — 

Variable k is the number of standard deviations the performance 
specification limit is to the process distribution mean, which is 
assumed to be centered. 


M±kcr x 
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MDR - The Influence Variables 


John F. Kennedy Space Center — 

a x 

Variable r is a ratio of two standard deviations. r = — 

a e 

• The numerator a x is “the true standard deviation of the product 
distribution.” In other words, the subject of interest. 

• The denominator a e is “the standard deviation of the errors of 
measurement.” Today we call this the measurement process 
uncertainty. 


The variable r is referred to as an “accuracy ratio.” 

• It is considered the origin of the TUR, but it is very different. 

• It has no confidence limits or coverage factors (± k). Therefore, r is a 
pure “uncertainty ratio.” 



u e 
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Linking the TUR to Measurement Decision Risk 

John F. Kennedy Space Center 1 


The relationship between r and k is shown graphically. 

The “knee” of the curve intersects the 1 % risk at an approximate r-value of 3:1 . 
Hayes and his colleagues added a little extra margin and thus 4:1 became 
the “rule of thumb.” 


CR versus Accuracy Ratio 
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Linking the TUR to Measurement Decision Risk 

John F. Kennedy Space Center — ■ 

The Z540.3 definition helps realign the TUR back to its origins in 
measurement decision risk. 

• To link the consumer risk accuracy ratio to the TUR, the 
denominator becomes an estimate of the measurement process 

uncertainty. 

CT X CT X 

r 'T'T 

• Using the relationship of the tolerance to the product mean p ± /ca x , 
the TUR can be represented as a ratio of intervals (± kn). 

Upper - Lower Upper - Lower ^ ’^x CT x ^\ a x 

TUR = — — = — — = = 

TU95 2k e -u e 2-k e -u e k e 'Ug 
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Linking the TUR to Measurement Decision Risk 

John F. Kennedy Space Center ■ ■ ■ 


• The k in the numerator represents the k factor in the consumer risk 
equation. This is the key that links the TUR and measurement 
decision risk. 


• The value of k for a calibration process can be represented by the 
End of Period Reliability (EOPR) for the Unit under Test (UUT). 

• An EOPR of 95.45% would then be k = 2.0 for a normal distribution. 
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Example - Digital micrometer 

John F. Kennedy Space Center ^ ^ — 

Micrometer and standard information. 


Parameter 

Digital 
Micrometer 
0-1 inch 
(0-25.4 mm) 

Gage Block, Class 2 

Tolerance 

± 0.0001 inch 
(± 2.54 pm) 

± 0.000004 inches 
(±0.1016 pm) 

Resolution 

± 0.00005 inch 
(± 1.27 pm) 

N/A 


UUT tolerance 0.0001 

TAR= = = = 25 

Std tolerance 0.000004 
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Example - Digital micrometer 

John F. Kennedy Space Center — 

Micrometer and standard information. 


Uncertainty 

Source 

Standard 
Uncertainty 
inches (pm) 

Confidence 
Level (%) 

Type 
(A or B) 

Distribution 

Gage Blocks 

0.000002 

(0.0508) 

95.00 

B 

Normal 

Resolution 

0.0000144 

(0.3658) 

100.00 

B 

Uniform 

Environmental 

0.0000001 

(0.00254) 

95.00 

B 

Normal 

Random Error 
or Repeatability 

0.0000083 

(0.2108) 

95.00 

A 

Student’s t 

Combined 

Uncertainty 

0.0000168 

(0.4267) 





TUR = 


Upper - Lower 
2U 95 


0.0002 

2 - 2 - 0.0000168 
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Example - Analog micrometer 

John F. Kennedy Space Center • ■ — ^ 

Micrometer and standard information. 


Parameter 

Analog 
(Vernier) 
Micrometer 
0-1 inch 
(0-25.4 mm) 

Gage Block, Class 
2 

Tolerance 

± 0.0001 inch 
(± 2.54 pm) 

± 0.000004 inches 
(±0.1016 pm) 

Resolution 

± 0.0001 inch 
(± 2.54 pm) 

N/A 


UUT tolerance 0.0001 
TAR = = = = 25 

Std_tolerance 0.000004 
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Example - Analog micrometer 

John F. Kennedy Space Center — — — ^ ^ — 

Micrometer and standard information. 


Uncertainty 

Source 

Standard 
Uncertainty 
inches (pm) 

Confidence 
Level (%) 

Type 
(A or B) 

Distribution 

Gage Blocks 

0.000002 

(0.0508) 

95.00 

B 

Normal 

Resolution 

0.0000255 

(0.6477) 

95.00 

B 

Normal 

Environmental 

0.0000001 

(0.00254) 

95.00 

B 

Normal 

Random Error 
or Repeatability 

0.0000201 

(0.5105) 

95.00 

A 

Student’s t 

Combined 

Uncertainty 

0.0000326 

(0.8280) 





Upper - Lower 0.0002 

TUR = — = 

2-U 95 2-2-0.0000326 


1.5 
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Discussion of Results 



John F. Kennedy Space Center 


Neither example meets the 4:1 rule, but do they meet the 
2% rule. 


• At a KSC lab, the nomenclature “micrometer” has an 
overall EOPR of 96%. 

• For the analog model number, the EOPR is 97.3%. 

• For a normal distribution, k = 2.21 


rco 


CR(k,r,b) = — 

71 J 


/'r-(k-t) -b 


-Ov) 


ds dt 


- r-(k+t)+b 
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Discussion of Results 



John F. Kennedy Space Center 


For the analog micrometer, use the EOPR data to solve for 
the value of ct x and r 


_ 0.0001 

x_ 2.21 


0.0000452 


_ 0.0000452 
f ~ 0.0000326 


1.387 


Consumer Risk: CR(2.21 ,1.387,0) = 0.9% 


For an EOPR of 96%, the consumer risk = 1 .3%. 
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Discussion of Results 



John F. Kennedy Space Center 


Consumer Risk over a range of EOPR values for both micrometers. 
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Summary and Conclusions 

John F. Kennedy Space Center 


• The TAR/TUR has been around for over 50 years 

• Originally intended to be temporary due to a lack of 
mathematical computing power 

• Various definitions have existed 

• Z540.3 TUR is very different from earlier definitions 

• The denominator consists of “the 95% expanded uncertainty of the 
measurement process used for calibration. ” 

• Measurement Decision Risk analysis provide a high quality 
assessment of the calibration process. 

• There are additional benefits to risk analysis, such as Producer Risk 
(False Reject) which can impact rework and product acceptance. 


Definitions within requirements are important because... 
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Summary and Conclusions 

John F. Kennedy Space Center ■ — 


The devil is in the details. 
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